ITEA  Journal  2 Oil;  32:  95-102 


DCF® — A  JAUS  and  TENA  Compliant  Agent-Based 
Framework  for  Test  and  Evaluation  of  Unmanned  Vehicles 
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Real-world  applications  for  unmanned  and  autonomous  systems  (UAS)  teams  continue  to  grow , 
and  the  scale  and  complexity  of  the  teams  are  continually  increasing.  To  reduce  life  cycle  costs 
and  improve  test  and  evaluation  ( T&E ),  we  increasingly  need  to  develop  a  generalized 
framework  that  can  support  the  design  and  development  of  T&E  approaches  for  multi-UAS 
teams  and  validate  the  feasibility  of  the  concepts,  architectures,  and  algorithms.  This  challenge  is 
most  significant  in  the  cognitive-social  domains,  where  the  development  of  test  approaches  and 
methodologies  are  difficult  because  of  the  emergent  nature  of  behaviors  in  response  to  dynamic 
changes  in  the  battlespace.  Today  much  of  the  initial  validation  effort  is  done  using  simulations, 
which  unfortunately  rarely  capture  the  complexity  of  real  world  effects  related  to  net-centric 
communications,  vehicle  dynamics,  distributed  sensors,  physical  environment  (terrain),  external 
disturbances,  etc.  Furthermore,  very  often  high  fidelity  simulations  do  not  scale  because  the 
number  of  UAS  increases.  This  article  addresses  DCF® — a  JAUS  and  TENA  compliant  agent- 
based  T&E  framework  for  simulated,  mixed-model  ( virtual  and  live-hardware  in  the  loop) 
and  live  testing  of  teams  of  unmanned  autonomous  systems. 

Key  words:  DCF®;  emergent  behavior;  real  world  battlespace;  simulation;  UAV  teams; 
unmanned  autonomous  systems;  validation. 

The  successful  deployment  of  unmanned 
platforms  in  the  battlefield  has  led  to 
an  increased  demand  for  greater  num¬ 
bers  of  unmanned  and  autonomous 
systems  (UAS).  Coupled  to  this  in¬ 
crease  in  demand  is  the  expectation  of  greater  levels  of 
autonomy  for  these  systems  (DOD,  2009).  There  is  a 
compelling  need  for  the  development  of  flexible  test 
and  evaluation  (T&E)  frameworks  that  can  address  the 
challenges  associated  with  testing  increasingly  complex 
systems  over  shorter  testing  cycles  (DOD,  2009; 

Streilein,  2009). 

Under  an  ongoing  effort  with  the  Test  Resource 
Management  Center,  Unmanned  and  Autonomous 
System  Test  program,  we  have  developed  an  integrated 
agent-based  T&E  framework  for  Simulated,  Mixed- 
Model,  and  Live  Test  and  Evaluation  of  teams  of 
unmanned  autonomous  systems.  At  the  core  of  this 
T&E  architecture  is  an  agent-based  distributed  control 
framework  (DCF)  (Kulis  et  al.  2008;  Manikonda  et  al 
2008a;  2008b).  As  part  of  ongoing  efforts,  an  enhanced 
JAUS  and  TENA  compliant  version  of  DCF  is  being 
developed  and  tested.  A  user  interface  with  integrated 


T&E  environment  development,  simulation,  and 
command  and  control  capabilities  has  been  imple¬ 
mented.  The  DCF  is  also  being  tested  and  evaluated  at 
the  Armament  Research  Development  and  Engineer¬ 
ing  Center  (ARDEC)  in  Picatinny  Arsenal  in  a 
relevant  test  environment. 

In  this  article,  we  discuss  the  details  of  these  recent 
enhancements  and  present  initial  results  from  a 
technology  development  conducted  at  ARDEC,  in¬ 
cluding  a  discussion  of  the  features  of  the  vignette 
editor,  our  implementation  of  JAUS  and  TENA 
compliance,  the  details  of  the  technology  demonstra¬ 
tion,  our  conclusions,  and  future  research  directions. 

Vignette  editor 

DCF®  (IAI,  Rockville,  MD)  is  a  small  and 
lightweight  T&E  framework  that  may  be  deployed 
on  any  computing  architecture  that  supports  the  Java 
Virtual  Machine  (Kulis  et  al.  2008;  Manikonda  et  al. 
2008a;  2008b).  The  DCF  adopts  an  agent-based 
modeling  paradigm  and  simplifies  the  implementation 
and  test  of  distributed  algorithms,  supports  mixing  of 
virtual  robot  agents  with  real  robot  agents,  and  enables 
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Figure  1.  DCF  vignette  editor. 


data  sharing  via  peer-to-peer  messaging.  A  controls- 
centric  design  is  adopted  wherein  a  robot  agent  is 
composed  of  a  sensor  layer,  state  estimators,  motion 
planners,  and  an  actuation  layer.  Algorithms  are 
implemented  as  plug-ins  and  include  hardware  device 
abstraction  and  self-contained  sensor-actuator  drivers, 
with  components  loaded  at  run  time  via  XML 
configuration  files.  The  DCF  currently  provides 
drivers  for  a  variety  of  robots  (e.g.,  iRobot  Creates, 
Pioneers,  Amigobots,  FireAnt,  LAGR),  and  a  wide 
ranges  of  sensors  (e.g.,  digital  encoders,  sonars,  stereo 
cameras,  GPS  receivers,  inertial  navigation  systems, 
LIDARs,  and  cameras).  The  DCF  also  provides 
hardware-in-the-loop  support,  discrete-time  and  real¬ 
time  simulations,  built-in  equation  solvers,  distribution 
across  multiple  computing  resources  with  repeatable 
results,  cross-layer  (network-level)  modeling,  and 
human  in  the  loop  support. 

To  further  facilitate  T&E,  the  DCF  now  provides  a 
user  interface  called  the  vignette  editor  (Figure  1).  The 
functions  of  the  vignette  editor  include  visualizing  the 
state  of  the  UAS  team,  creating  T&E  scenarios, 
monitoring  the  UAS  team  performance,  and  generating 
automated  T8cE  reports.  Most  importantly,  the  vignette 
editor  provides  the  user  with  the  ability  to  issue  real-time 
commands  to  the  team  and  to  upload  a  new  distributed 
control  algorithm  (mission)  on  the  fly.  A  description  of 
the  main  components  of  the  vignette  editor  follows. 


Project  View 

The  project  view  provides  a  tree  view  of  all  of  the 
robots.  From  this  view,  robots  can  be  added  and 
configured  and  missions  can  be  built  and  assigned. 
Each  robot  element  displays  the  set  of  actuators,  sensors , 
state  estimators ,  coordinators ,  and  planners  based  on  the 
robot  agent  architecture. 

Run-time  View 

The  run-time  view  provides  a  view  of  all  of  the  robot 
agents  in  the  DCF  community.  From  this  view,  the 
contents  of  the  sensor  map  and  the  active  plan  are 
displayed.  Each  element  within  the  tree  can  be 
selected,  and  the  corresponding  parameters  such  as 
serial  port  or  desired  position  can  be  viewed  via  the 
properties  sheet  view.  The  run-time  view  can  be 
extended  to  support  new  device  types  as  programmers 
create  them.  Via  the  context  menu  and  the  local 
toolbar,  users  can  assign,  pause,  and  resume  plans; 
display  a  live  video  feed;  and  run  the  robot  by  remote 
control. 

Components  View 

The  components  view  provides  a  view  of  all 
components  that  can  be  added.  The  user  simply  has 
to  drag  the  selected  component  onto  the  map  to  make 
the  necessary  change. 
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Figure  2.  Serial  mission  editor  with  selected  waypoints. 

Mission  Building  Editors 

In  addition  to  building  missions  with  XML  files, 
two  graphical  mission  editors  are  supported.  The  serial 
mission  editor  allows  the  user  to  string  discrete 
behaviors  into  a  serial  sequence.  These  behaviors  are 
then  executed  by  the  robot  sequentially  ( Figure  2).  A 
state  machine  mission  editor  allows  mission  builders  to 
use  behaviors  from  the  component  view  and  visually 
configure  them  in  a  finite  state  machine  (Figure  3). 

Map  Editor 

The  map  editor  is  an  eclipse  editor  implemented 
within  the  uDig1  application  to  provide  a  way  to 
display  a  series  of  map  layers  such  as  geographical  maps 
and  road  locations.  It  provides  a  two-dimensional 
canvas  to  display  layers  on  a  map  such  as  robot 
locations.  Users  can  drag  robots  to  adjust  their 
positions  and  orientations. 

Web  Map  Tile  Server  Visualization 

A  series  of  uDig  Tenderers,  using  any  standard  Web 


,fci  5tate  Machine  Mission  Editor . .-£3 


Figure  3.  State  machine  editor. 


Figure  4.  DCF  map  view  with  open  street  maps. 

map  tile  server  for  the  back  end,  were  created  to 
visualize  street  maps,  aerial  photographs,  and  terrain 
maps.  These  components  download  the  images  from 
Web  servers,  cache  them  locally,  and  display  them 
accordingly  in  the  map  editor  (Figure  4). 

Digital  Terrain  Elevation  Data 
(DTED)  Visualization 

DTED  is  a  file  format  used  by  the  military  to 
encode  elevation  data  over  a  large  scale.  Leveraging  an 
existing  technology,  a  DTED-based  UDig  Tenderer 
was  built.  The  DTED  Tenderer  displays  a  topographic 
map  built  from  DTED  level  0,  1,  or  2  (Figure  5). 

Streaming  Video 

The  vignette  editor  supports  any  number  of 
incoming  video  streams,  as  long  as  their  sources  are 
known.  Users  can  right  click  a  robot  in  the  run-time 
view,  and  select  Show  Video  Stream  to  bring  up  the 
video  window  for  a  particular  robot. 

Metrics  Evaluation  Integration 

Visualization  capabilities  for  real-time  metrics  have 
been  incorporated  into  the  vignette  editor.  Users  may 
visualize  metrics  via  configurable  plots  during  run  time 
using  the  JFreeChart  library.  Numerous  types  of  plots 
are  supported  via  JFreeChart.  An  example  of  a  time 
sequence  chart  showing  the  navigation  error  of  a  robot 
is  shown  in  Figure  6. 

Joint  Architecture  for  Unmanned 
Systems  (JAUS)  Compliance 

JAUS  is  a  messaging  standard  that  has  been 
mandated  by  the  DoD  to  facilitate  interoperability 
between  unmanned  systems  (OpenJAUS  2010).  In 
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Figure  5.  Screenshot  Google  map  with  DTED  topographic  overlay. 


addition  to  the  messaging  standard,  JAUS  also  defines 
a  series  of  hierarchically  organized  software- naming 
schemes  to  reduce  confusion.  These  object  names  are 
Subsystem, ,  Node,  Component,  and  Instance. 

A  subsystem  is  generally  viewed  as  a  complete  hard¬ 
ware  and  software  solution  such  as  an  unmanned  ground 
vehicle  (UGV)  platform  or  an  operator  control  unit.  A 
node  is  generally  viewed  as  a  process  mnning  on  a 
dedicated  central  processing  unit.  Components  are  logically 
organized  software  components  that  generally  perform 
some  specific  sensing  or  driver  level  task  within  the  node. 

There  are  three  levels  of  JAUS  compliance — Level 
1,  Level  2,  and  Level  3.  Level  1  compliance  indicates 
that  all  communication  between  JAUS  subsystems  is 
done  via  JAUS  messages.  Level  2  compliance  indicates 
that  all  communication  between  JAUS  nodes  is  done 
via  JAUS  messages.  Level  3  compliance  indicates  that 
all  communication  between  JAUS  components  is  done 
via  JAUS  messages. 

To  enable  JAUS  compliance,  we  implemented  a 
DCF-style  JAUS  controller  that  sends  JAUS  messages 
to  specific  JAUS  components  on  the  platform.  Our 
initial  implementation  is  Level  1  compliant  because  it 


sends  and  receives  messages  at  the  subsystem  level.  The 
JAUS  controller  was  designed  to  directly  interface  with 
the  Primitive  Driver,  Reflexive  Driver,  Local  Waypoint 
Driver,  and  Global  Waypoint  Driver  to  support  driving 
the  platform.  Additionally,  periodic  updates  of  impor¬ 
tant  sensor  data  were  required.  Global  Pose  Sensor  and 
Local  Pose  Sensor  were  implemented  to  support  the 
creation  of  higher-level  DCF  behaviors  that  allowed 
more  complex  tasks  such  as  perimeter  surveillance. 

Other  data  that  were  implemented  included  the  image 
data  from  the  visual  sensor  and  platform  operation  data 
from  the  primitive  driver.  Additionally,  Fire  Ant- specific 
experimental  custom  messages  were  implemented  to 
support  control  of  the  pan/tilt/zoom  camera,  querying 
the  encoders,  and  querying  the  LIDAR. 

TENA  Compliance 

The  Test  and  Training  Enabling  Architecture 
(TENA)  is  a  middleware  designed  to  support  interac¬ 
tion  between  remote  software  components  (DOD 
CTEIP  2010a).  The  specific  applications  that  use 
TENA  are  T&E  applications  where  users  want  to 
integrate  data  collected  with  remote  test  ranges. 
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Figure  7.  Some  of  ARDEC  UGV  platforms:  (a)  FireAnt,  (b)  Talon,  and  (c)  Packbot. 


TENA  classes  are  implemented  in  their  own  program¬ 
ming  language,  which  is  similar  in  syntax  to  C++,  and 
compiled  remotely  by  the  TENA  community  at  the 
TENA  Software  Development  Architecture  Web  site. 

To  facilitate  interfacing  with  TENA,  we  developed  a 
DCF-TEN  A  integration  approach  to  support  relaying 
DCF  robot  agent  data  across  the  TENA  infrastmcture 
and  support  waypoint  tasking  from  remote  TENA 
applications.  Our  initial  implementation  adopts  the 
“gateway”  architecture  as  discussed  in  DOD  CTEIP 
(2010b).  A  series  of  TENA  classes  was  developed  and 
compiled,  which  are  available  via  the  tena-sda  Web  site 
(DOD  CTEIP  2010a).  TENA  application  program¬ 
mers  can  task  robots  to  an  (X,  Y)  location  using  the 
TENA  method  moveToLocation.  Additionally,  they 
can  queiy  the  position  of  the  robots  as  well.  Future 
development  will  be  done  by  integrating  with  an  existing 
TENA  repository,  and  logging  data  to  it. 

Evaluation  of  DCF  at  ARDEC  in 
Picatinny  Arsenal 

ARDEC  personnel  at  Picatinny  Arsenal  have 
developed  the  Firestorm  system,  a  fully  integrated  and 
scalable  decision  support  tool  suite  for  the  mounted- 
dismounted  warfighter-commander.  Firestorm  is  an 
open,  extensible,  and  scalable  family  of  tools  that  support 
network  centric  warfare  and  can  be  configured  for  user 
experimentation  in  either  a  virtual  or  field  environment. 
ARDEC  is  also  developing  the  concept  of  a  Joint 
Manned-Unmanned  System  Team  (JMUST),  for  which 
target  handoff  and  sharing  of  situational  awareness 
data  between  humans  and  unmanned  and  autonomous 
systems  working  together  have  been  demonstrated.  This 
is  a  groundbreaking  program  in  terms  of  implementation 
of  advanced  concepts  for  human-UAS  teaming  in 
combat  operations.  Some  examples  of  unmanned 
systems  currently  being  integrated  at  ARDEC  include 
military  robots  such  as  the  FireAnt,  PackBot,  Talons,  and 
Scouts  (Figure  7).  However,  because  new  unmanned 
platforms  (manufactured  by  different  vendors  with 


different  levels  of  JAUS  compliance,  if  at  all)  are  being 
integrated  into  Firestorm,  new  challenges  are  emerging. 
There  is  a  critical  need  at  ARDEC  for  a  framework  to 
coordinate  the  behavior  of  these  platforms  and  to  test  the 
performance  of  teams  of  unmanned  systems. 

To  address  this  need,  ongoing  efforts  with  ARDEC  are 
designed  to  validate  and  demonstrate  the  benefits  of  DCF 
to  a  multirobot  coordination  task  performed  in  a  realistic 
environment.  Use  cases  for  “perimeter  surveillance” 
scenarios  were  identified  and  implemented  in  two  stages. 

Single  UGV  perimeter  surveillance.  For  an 

unmanned  system  to  conduct  autonomous 
perimeter  surveillance,  the  operator  would 
provide  a  region  (such  as  a  building,  for 
example)  around  which  the  unmanned  system 
should  conduct  surveillance.  The  unmanned 
platform  would  have  to  generate  a  surveillance 
path  plan  around  the  region  of  interest  as  a 
sequence  of  waypoints.  At  each  way  point  the 
unmanned  system  would  conduct  a  surveillance 
activity,  such  as  searching  for  candidate  targets 
using  a  camera  (the  target  could  be  predefined 
or  a  moving  object).  If  such  a  target  is  identified, 
a  message  would  be  sent  to  the  operator  control 
unit  together  with  an  image  of  the  target. 

Multiple  UGV  perimeter  surveillance.  As  in 
the  previous  discussion,  the  operator  would 
provide  a  region  around  which  the  team  of 
unmanned  systems  should  conduct  surveillance. 

The  unmanned  platforms  would  collaboratively 
generate  a  surveillance  path  plan  around  the 
region  of  interest  as  a  sequence  of  waypoints  for 
each  of  the  unmanned  platforms.  At  each 
waypoint  the  unmanned  systems  would  conduct 
a  surveillance  activity,  as  in  the  single  platform 
case.  Higher  and  more  interesting  behaviors  can 
be  achieved  by  multi-UAS  systems.  For  exam¬ 
ple,  if  a  given  target  is  identified  by  UAS-1  (say 
UGV  1),  it  could  be  confirmed  or  handed  over 
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to  UAS-2.  UAS-2  could  be  commanded  to 
follow  the  target  while  UAS-1  continues  the 
surveillance,  etc.  This  decision  could  be  taken 
with  or  without  operator  intervention. 

The  main  stages  of  the  perimeter  surveillance 
mission  implemented  in  collaboration  with  ARDEC 
personnel  were  the  following: 

a.  Selection  of  region  of  interest.  The  operator  uses 
the  mouse  to  indicate  on  the  vignette  editor  the 
region  over  which  the  UGVs  are  to  perform 
surveillance  (Figure  8).  This  region  can  be  any 
nonintersecting  polygon.  Once  the  region  is  select¬ 
ed,  the  planner  defines  a  sequence  of  waypoints  that 
the  UGVs  are  to  traverse  during  the  surveillance. 

b.  Deployment  of  UGV  team.  The  UGV  robot 
agents  negotiate  over  equally  spaced  starting 
positions  of  each  platform.  Once  a  starting  point 
for  each  platform  is  assigned,  both  platforms 
navigate  to  their  respective  starting  positions 
(Figure  9). 

c.  Surveillance.  Both  robots  start  a  clockwise  rotation 
pattern  traversing  each  of  the  waypoints  in  the 
perimeter  of  the  region  of  interest.  At  each  waypoint 
the  platforms  stop  and  conduct  a  target  detection 
search  where  they  pan  their  cameras  toward  the 
outside  of  the  region  of  interest  (Figure  10). 

d.  Target  detection.  If  a  target  is  detected  during  any 
point  of  the  surveillance  mission,  a  pop-up  menu  is 
displayed  on  the  vignette  editor  prompting  the 
operator  to  take  an  action  such  as  “ Continue 
Surveillance  ,”  Remote  Control ‘ Follow  Target ,” 
etc.  If  no  action  is  taken  by  the  operator  within  a 
timeout  period,  the  surveillance  mission  continues. 

e.  End  of  mission.  At  the  completion  of  the  mission, 
the  operator  has  the  choice  of  manually  tele- 
operating  each  of  the  platforms  or  giving  them  all  a 
command  to  go  back  to  their  starting  positions. 

The  use  cases  listed  were  implemented  over  a 
number  of  visits  to  Picatinny  Arsenal.  In  June  2010, 
a  coordinated  perimeter  surveillance  mission  using  two 
Fire  Ant  UGVs  was  successfully  demonstrated.  Fig¬ 
ures  11  and  12  show  the  two  platforms  performing  the 
prescribed  mission. 

Conclusions  and  Future  Research 

In  this  article  we  presented  the  details  of  enhance¬ 
ments  made  to  DCF,  a  T&E  infrastructure  developed 
for  unmanned  and  autonomous  systems.  We  focused 
on  the  vignette  editor,  JAUS  and  TENA  compliance, 
and  test  and  validation  at  ARDEC.  This  enhanced 
system  has  already  reached  a  technology  readiness  level 
of  6  and  is  currently  in  the  process  of  being  evaluated  at 
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Figure  8.  Selection  of  region  of  interest. 
Figure  9.  Deployment  of  UGV  team. 
Figure  10.  Surveillance. 


Picatinny  Arsenal.  Future  research  includes  further 
enhancements  to  the  vignette  editor,  adding  further 
JAUS  compliance  levels  and  improving  the  initial 
implementation  of  the  TENA-DCF  gateway.  Further 
enhancements  to  the  vignette  editor  to  allow  test 
engineers  to  develop  T&E  scripts  for  command  and 
control  approaches  for  navigation  through  a  cluttered 
terrain  and  urban  terrain,  using  non-line- of- sight 
instrumentation  techniques;  UAS  team  coordination 
and  performance  in  nondeterministic,  unscripted 
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Figure  11.  Fire  Ant  1  and  Fire  Ant  2  during  coordinated 
perimeter  surveillance  mission. 


modes  of  operation  (emergent  behavior);  and  fault 
tolerance  under  various  failure  modes  and  bandwidth 
constraints  (hardware,  sensor,  network)  need  to  be 
developed.  While  DCF  currently  supports  drivers  for  a 
large  class  of  UGVs,  in  future  work  UGV  drivers  and 
sensor  payload  for  Department  of  Defense  UGVs  will 
be  further  developed  and  tested.  □ 
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Figure  12.  lAI’s  vignette  editor  operating  as  operator  control  unit  to  control  a  coordinate  perimeter  surveillance  mission  at  Picatinny 
Arsenal.  The  light  blue  disks  correspond  to  the  UGVs  (Fireant  1  and  Fi reant  2);  the  perimeter  under  surveillance  is  shown  as  a 
sequence  of  waypoints  that  the  UGVs  are  to  follow.  The  bottom  right  corner  shows  a  live  video  of  Fireant  2  taken  in  real  time. 
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Endnotes 

xuDig  is  a  GIS  framework  for  Eclipse  (see  http://udig.refractions.net/). 
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